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Abstract 

The minimum-time control problem consists in finding a control policy that will drive a 
given dynamic system from a given initial state to a given target state (or a set of states) as 
quickly as possible. This is a well-known challenging problem in optimal control theory for 
which closed-form solutions exist only for a few systems of small dimensions. This paper 
presents a very generic solution to the minimum-time problem for arbitrary discrete-time 
linear systems. It is a numerical solution based on sparse optimization, that is the minimiza- 
tion of the number of nonzero elements in the state sequence over a fixed control horizon. 
We consider both single input and multiple inputs systems. An important observation is 
that, contrary to the continuous-time case, the minimum-time control for discrete-time sys- 
tems is not necessarily entirely bang-bang. 

Keywords, minimum-time control problem; time-optimal problem; optimal control; sparse 
optimization ; discrete-time systems. 

1 Introduction 

Time optimal control is an important particular instance of the general theory of optimal con- 
trol developed since the 50's. It refers to the problem of transferring the state of a dynamic 
system from a given initial state to a certain target state (or a set of states) in minimum time. 
This problem can be encountered in many military applications such as the interception of an 
attacking missile or in mobile robotics applications. Attempting to provide a closed-form so- 
lution to the general minimum-time control problem is a daunting task that can get quickly 
hopeless. For this reason, the only existing analytic solutions concern simple continuous-time 
examples of small dimensions [ll[l5l[6]. ^ ven ^ these simple cases, the problem proves to be 
extremely hard to tackle. For continuous-time systems, the minimum-time problem is gener- 
ally addressed by applying the minimum/maximum principle of Pontryagin [1J. When the 
control variables are bounded, a general result is that the optimal control policy is a bang-bang 
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policy that is a policy in which the control switches between a number of extreme values. In 
discrete-time systems, results on minimum-time problem are rather very scarce. Only a few 
papers (TTl[T7l l3l[T4 | investigated the problem. In a more recent work reported in [12J, a closed- 
form optimal policy is derived for the well-known double integrator system. Another relevant 
work is the one of |20ll , where an intricate derivation of a minimum-time control for a chain 
of three integrators is presented. Inspired by the book |T8| , the author of [12| showed on the 
particular double integrator system that contrarily to the continuous-time case studied in HUH, 
the solution to the minimum-time problem with bounded controls, is not necessarily entirely 
bang-bang for discrete-time systems. The results of this paper will, even though they are not 
intended for characterizing the form of the optimal-time control law, confirm this intriguing 
fact. 

Contributions. In this paper, we consider the problem of steering the state of a linear discrete- 
time system from a given nonzero state to the zero-state in minimum time (and maintain it 
at zero at all subsequent instants). The controls to be selected for achieving this goal are con- 
strained to lie in a bounded convex set. The paper develops a new, generic and computa- 
tionally feasible approach to the minimum- time problem for discrete-time linear systems. Our 
approach is based on a sparse optimization of the state sequence, that is the minimization of 
the number of nonzero elements contained in the state sequence over a fixed and finite control 
horizon. In effect, the state sequence associated with the time-optimal control policy can be 
viewed as the sparsest state trajectory achievable by the considered systemQ 
Sparse optimization refers to the general problem of minimizing the number of nonzero ele- 
ments in a sequence of scalars or a sequence of vectors. It has proved to be a powerful method 
having impressive applications in many different engineering areas such as compressed sens- 
ing [8 1, signal processing [5|, computer vision |Tl9ll , system identification [2J. Inspired by these 
results, we show in this paper that sparsity-inducing optimization techniques can efficiently 
solve the minimum-time control problem. 

Note however that a direct attempt to solve the sparse optimization problem is computation- 
ally very intensive and somewhat inelegant. We therefore approximate it by minimizing a cost 
functional constructed as an appropriately weighted sum of ^-norms of the system states. This 
relaxation of the minimum-time problem has the advantage of being convex and therefore solv- 
able by some reliable numerical tools Il4l ll3l . Sufficient conditions are derived for the relaxed 
convex optimization to exactly recover the solution to the minimum-time control problem. In 
contrast to many existing methods which studied particular examples, our method applies to 
arbitrary linear systems. 

Outline. The rest of the paper is organized as follows. The minimum-time control problem is 

: A vector sequence is said to be sparse if it contains many zero vectors. And a vector sequence is sparser than 
another vector sequence if the first contains a larger number of zeros than the second. As for the paradigm sparse 
optimization, it is used here to designate an optimization problem which aims at minimizing an integer such as the 
cardinality of a set, the rank of matrix, . . . 
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formally set up in Section |2] along with some working assumptions. Some preliminary analysis 
of the solution is also carried out. The proposed approach is developed in Section |3j Section [4] 
contains a numerical illustration of the capability of our approach. Final remarks are provided 
in Section [5] 

2 The minimum-time control problem 

Consider the discrete-time linear time-invariant (LTI) system represented by 

x(t + l)=Ax(t)+Bu(t), x(0)=x (1) 

where t G Z> refers to time step, x{t) G W 1 is the state, u(t) G R nu is the input. A G R nxrt and 
B G M nxn " are the system matrices. The objective of this work is to provide a solution to the 
following control problem. 

Problem 1. Given a linear discrete-time system such as with the initial nonzero state x(0) = xq, 
find the control sequence u(0), . . . , u(T* — 1), subject to the constraints 

u(t)eU, t = 0,...,T*-l 

such that the system state is driven to the zero-state x(T*) = in minimum time. That is, the integer T* 
must be the minimum time at which the system reaches the zero-state. U c M n " represents a bounded 
convex set and will be referred to as the set of admissible controls. It is additionally required that U 
contains the origin (the zero input). 

More formally, the control problem to be studied in this paper reads as follows 

min T 

«(o),...,u(T-l) 

subject to Eq. §\§ 

x(T) = and x{t) ^ 0, t -- 
u(t) eU, t = 0,...,T-l 

In the setting of this paper, U can be any convex set in R n ". In particular, U can be an ^-rtorm 
ball of the form {u G R n " : ||u|| 2 < r} or an -norm ball {u G M n " : |itj| < n, i = 1, . . . ,n u }. We 
assume here that the initial state xo is nonzero and the target state is equal to zero. An implicit 
requirement is that the system must stay in the zero-state after it reaches it. Obviously, for the 
above minimum-time control problem to make sense, we need to assume that the zero-state is 
reachable in finite time from xq, under the control constraints u(t) G U. The problem would 
be trivial if the control variables were not constrained i.e., if U were equal to M n " because the 
minimum-time T* could, in this case, be simply obtained as T* = min {i : A f xo G im(At)} < n 
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(2) 



o,...,r-i, 



with 

A t = Ia^B ■■■ AB b], (3) 



im(At) referring to the range space of A t . Many solutions would then be possible once A^* is a 
rectangular matrix that is, once n u T* > n. The case of real interest is the one where U is sharply 
bounded. In this case the minimum-time is formally given by 

T* = min {t : U l n F^ t {-A l XQ) ^ 0} (4) 

whereW* = Wx ••• xU is the t-cartesian product of the setU and F& t (z) = {«6lR h " : A t u = z]. 
Note that T* depends on the system (through its matrices), the control set U and the initial state 
xq. Also, it is worth noting from ((U) that U T * n F^ t (— A T * xq) is the set of time-optimal control 
sequences. Since this set is convex, we see that whenever the time-optimal control sequence is 
not unique, there are infinitely many control sequences that can achieve the minimum time. 

For single input continuous-time systems, it is well-known from the optimal control lit- 
erature that the solution to the minimum-time problem is, when the controls are bounded, a 
bang-bang control policy. A bang-bang control policy is the one in which the control switches 
between two extreme values, for example u(t) = ±lforW = {u e R : \u\ < 1}. For discrete-time 
systems however the control policy is not necessarily bang-bang [12| . 

Note that posed as in <0), the minimum-time problem is a hard mixed integer-continuous 
variables optimization problem. In the sequel, we propose a convex relaxation which is more 
numerically tractable. 

3 The sparse optimization based solution 
3.1 Description of the approach 

In this section, we present the main contribution of the paper. It consists in the development 
of a new convex optimization based method for computing the solution to the minimum-time 
control problem. To proceed with the presentation, denote by T* the minimum possible time 
in which the zero target state can be reached from initial state xo and let T be a known upper 
bound of T* , i.e. T* < T. This assumption will remain in force throughout the paper. Let x*(-) 
be a (many of them may exist) time-optimal state trajectory. Then by fixing the control horizon 
to be equal to T, the state sequence x*(0),x*(l), . . .,x*(T* - l),x*(T*), . . .,x*{T) is such that 
x* (t) ^ for t <T* and x* (t) = for t > T*. The fundamental idea of our approach is based on 
the important observation that for x*(-) to be the state trajectory of system corresponding 
to the minimum-time control policy, the vector sequence {x*(t)} must be one of the sparsest 
achievable state trajectories. That is, the sequence {x*(t)} must contain as many zero vectors 
as possible with all zero states corresponding to the highest values of the time index t. This 
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feature of the state sequence {x*(t)} is graphically depicted as follows 



x*(l) a?* (2) ••• x*(T*-l) x(T*) ■■■ x(T) 

##•••# ... 

where # means nonzero. In fact, requiring the sequence {x*(t)} of state vectors to be sparse is, 
in principle, equivalent to making sparse the scalar sequence {||^*(t)|| 2 }/ where ||-|| 2 refers to 
the euclidean norm. We therefore reformulate problem (0 as the problem of minimizing over 
the horizon T, the number of nonzero elements in the sequence { \\x*(t) || 2 }, 

min |{i:||*(i)|| 2 ^0}| 
u(0),...,u(I — 1) 

subject to Eq. §B) 

3T 1 <T:x(t) = 0,t = T 1 ,...,T ( 5 ) 
andx(t) / 0, t = 0, ... ,T X - 1, 
u(t) eU, t = 0,...,T- 1. 

Here, the notation \S\ with S representing a set, stands for the cardinality of the set S. Like 
10, problem (0 is a hard combinatorial problem. Both problems can be obviously solved in a 
somewhat inelegant way by trying any possible value for T\ (starting from T\ = 1) until the 
minimum time is obtained, i.e. until the constraints associated with problem are satisfied. 
This comes however with a huge numerical complexity as it involves solving an a priori unde- 
fined number of times a constrained control problem over a time horizon T, which T is possibly 
large. 

A more effective way to tackle problem (O is to replace it by its "best" convex approximation. 
This translates into the formulation 

T 

min J({u{k)} T k Zl) =Y w{t)\\x(t)\\ 2 

(6) 

subject to Eq. ^Q) 

u(t) eU, t = 0,...,T -l 

where {w(t)} is a strictly increasing sequence of positive weights. Noting that 

x(t) = A f x(0) + A t u t (7) 

with A t defined as in (O and 

u t = [u(0) T ... u(t-l) T l T , (8) 
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the cost functional J in ((6]) can be expressed in function of the control variables as 

T 

J( {u(k)}^~Q ) = £ w(t) ||^(0) + A t u t \\ 2 
t=i 

with A t and u\ defined respectively as in (0 and (8). The motivation for the optimization 
problem (|6]) is that the sum-of-^-riorms criterion has the property of promoting the obtention 
of a control sequence such that, as desired, the state sequence {x(t)} is as sparse as possible, 
see e.g. IflOl 116] for some discussions. The non-smooth sum-of-^2 -norms criterion is in fact a 
generalization of the ^i-norm which is popular in the literature of compressed sensing (HEl f° r 
its ability to convexly approximate the combinatorial ^o" n orm. A clear distinction needs to be 
made between the sum-of-norms cost functional involved in ^ and the more usual sum-of- 
squared-norms. The former is non-smooth, non-differentiable at zero and tends to stimulate 
the obtention of a sparse state sequence. The latter is smooth and differentiable, so that it does 
not favor sparse solutions. The increasing sequence {w(t)} of weights aims at forcing faster 
(non-smoothly) the states x(t) to zero as t is increasing. 

Note that the formulation ((6ll is a convex approximation of the initial minimum-time control 
problem ((J)). Problem |6]) can, contrary to (O and (J5)), be efficiently solved using some reliable 
numerical solvers such as e.g., the CVX toolbox |[T3ll4l|. However we may wonder under what 
conditions the solutions of both optimization problems coincide. In other words, can the time- 
optimal problem be exactly tackled through convex optimization? 

An answer is provided by Theorems [Hand 12 For ease of presentation of the first theorem, we 
need to introduce a few more notations. For any finite input sequence u(-) = {u(0), . . . , u(T — 
1)}, let u tr t < T, be defined as [u(0) T , ...,u(t- 1) T ] T G M tn ". We call U T (x ) the set of all 
input sequences of length T which solve problem <|6]) when the system starts from state xq that 
is, 

U T (x ) ={«"(•) = K(0), . . . , u°(T -1)}CW: 

J(u°(-)) < J(«(.))V«(-) C«}. 

Ut(^o) is in fact a convex set so that it is, unless reduced to a singleton, an infinite uncountable 
set. Now denote by U^(xo) the set of all truncated sequences (elements) of the form ut taken 
from \1t{xq) and define 

Vt(xq) = _ min ll^aco + AtUtlL. (9) 

«teUy(a;o) 

A^o+Atut^O 

The so-defined rfr(xo) is a lower bound for any non-zero state x(t) which is reachable by a 
control sequence u t G U^(xo). Hence ||x(t)|| 2 > t]t{xq) whenever the state x(t) generated by 
Ut G U^(xo) is different from zero. 

Theorem 1. Fix the control horizon to satisfy T* <T and assume that the set U of admissible controls 
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is bounded by a number r > 0. If the weights sequence {w (t)} are recursively constructed as 



w(l) = 1, 

2r (10) 

w(t) > — r^Efc=i V^||A fc || 2 «;(fc) /or t> 2, 
Vt{xo) 

then the convex problem © provides a solution to the minimum-time control problem ©. 

Before proving the theorem, we make the following observation. 

Lemma 1. Assume that the weight sequence {w(t)} is strictly positive. Then by denoting with u°(-) 
and x°(') respectively the control and state trajectories corresponding to a solution to problem ©, the 
following holds. Ifx°(to) = Ofor some to € {1, ... , T}, then x°(t) = Ofor any t such that to < t < T. 

Proof. Define a control sequence as u l (t) = u°(t) for t < to — 1 and = for t > to- 
Define to be the state sequence induced by the control sequence n 1 (-). Then = x°(t) 
for any t < to and = for any t > to- Since «"(•) minimizes the cost function in we 
can write 

T T 

t=i t=i 

T 

w(t)\\x°(t)\\ 2 <0. 

t=t +l 



which implies that 



This, by virtue of the fact that w(t) > for any t, is true only if x°(t) = for any t = to + 
1,...,T. □ □ 

The lemma implies that if an instance of problem ® solves the minimum-time problem 
with a control horizon T > T* , then the solutions to all instances of © having a control horizon 
rpi y j,*^ a j go ac ] 1 j eve minimum time. 

Proof of Theorem^ Use the notations u°{-) and x°{-) to represent respectively the control and 
state trajectories corresponding to the solution to problem ©. We just need to show that if there 
is a control policy achieving the minimum-time T* , then x°{-) satisfies necessarily x°(t) = for 
all t > T*. For this purpose, denote with u*(-) the minimum-time control trajectory and with 
x*(-) the associated state trajectory. From the definition of x°(-), it holds that 



J2w(t)\\x°(t)\\ 2 <j2w(t)\\ 3 

t=l t=l 

Considering the fact that x* (t) = Vi > T* and using formula 0, the above equality implies 
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that 



t t*-i r*-i 

£ «,(*) ||z°(t)|| 2 < ^ «,(*) ||z*(i)|| 2 - ^ «;(*) ||x°(t)|| 2 

t=T* t=l t=l 

T*-l 

< 53 ^)ii**(t)-*^)n 2 

T*-l 

= 53 ™(i)||A t (u t *-«?)|| 2 . 
t=i 

Because u° and are included in the bounded set U, the following inequality holds 

w(t) \\A t (u* t - v°)\\ 2 < 2rw(t) \\A t \\ 2 <ft 

so that we arrive at 

T T*-l 

53 w(t) \\x°(t)\\ 2 < 53 2rw{t) || A t || 2 sft. 

t=T* t=l 

If there were a 7\ in {T*, . . . , T} such that x°(Ti) ^ 0, then by LemmaHJ x°{T*) / 0. We would 
then have 

T*-l 

VT (x )w(T*) < w(T*) ||x°(T*)|| 2 < 53 2rw(t) ||A t || 2 Vt. 

t=i 

However, this is incompatible with the definition (flOl) of the weights {w(t)}. Therefore x°(t) = 
for any t > T* . In other words, the control u°(-) is a solution to the minimum-time problem as 
claimed. □ □ 

Theorem[l] provides us with a sufficient condition on the weights sequence for a minimum- 
time control to be obtained by means of convex optimization. While condition ((To|) offers a 
theoretical expedient for problem (|6]) to solve the minimum-time problem, it may not be of 
great practical significance if the control horizon T is large. The essential reason for that is the 
undesirable fact that the weights may grow too rapidly. This is particularly critical when the 
considered system is unstable. Having too large weights w(t) for big values of t may have 
the numerical inconvenience of annihilating the terms of the cost functional indexed by small 
time indexes since the corresponding weights will be too small. In fact, it has turned out in 
practice that the condition (flO]> is somewhat conservative. A weight sequence which increases 
linearly with respect to time is in general capable of providing an optimal solution. Another 
issue related to how to fulfill condition ((TU)) , is that the parameter t)t(xo) may be difficult to 
compute in practice. One can get around this difficulty by just picking t]t(xo) to be sufficiently 
small. Note that a subsequent normalization of the weights is possible. 

The next theorem gives a sufficient condition under which solving problem §6fy leads uniquely 
to the minimum-time control sequence. 
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Theorem 2. For any control sequence u(-) and any integer T > 1, define 

T 



Pt{u{-)) = £>(*) II A 



tu t \ 



t=i 



Denote with UQlA the Minkowski different of the set Ufrom itself and introduce, for any T\ < T, the 
number 

fju(T 1 ,T)= sup — TTTV- I 11 ) 

Assuming that the weight sequence {w(t)} has strictly positive elements, the following holds. 
If there is T lr T* - 1 < T x < T, such that 

m (T 1 ,T)<l/2, (12) 

then the solution to problem © achieves the minimum time control. If in addition rank(I?) = n u , the 
control sequence achieving the minimum time is unique. 

Proof. Let us adopt the same notations as in the proof of Theorem [TJ From that proof, we know 
that 



T*-l 

Y, w{t) \\x°{t)\\ 2 < y «»(*) ii a *k - *tju-> 



t=T* t=l 



Because u*(t) = for any t > T* , we have x*(t) = A 1 xq + A t u* t = so that A l x Q = -A t ul for 
t > T*. As a consequence, x°(t) can be expressed as x°(t) = A t (u° — u^)\/t>T*. Plugging this 
into the above inequality yields 



T*-l 



Y W (t) W&tUth ^ 2 Yj W ^ H A ^*ll2 (13) 
t=l t=l 

where Ut = u° — u*, u(-) being the sequence defined by u(-) = «"(•) — «*(•) C U U. If 
Pt(u(-)) 0, then inequality ( fl3l) implies that 

PT*-i(u(-)) 

Pu{Ti,T) > > 1/2 

Pt{u{-)) 

However, this is incompatible with the assumption (Tl2")l of the theorem. Therefore it necessarily 
holds that pr{u(-)) = 0. With w(t) > for any t, this immediately leads to the conclusion that 
A t (u° -u*) = for any t = 1, . . . , T. In particular, 

x°{T*) = A t *xq + A T *u° T * = A T *(u° T , -u* T *) = 0. 



2 The Minkowski difference of two sets A and B is the set A Q B defined by A Q B — {a — b : a e A, b G B}. 
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In other words, the control sequence u°(-) achieves the minimum time. 

Uniqueness of the solution is immediate by writing explicitly the equations A t ut = for 
t = 1,...,T. We get 

Bu(0) = 0, 

ABu(O) + Bu{\) = 0, 

A 2 Bu(0) + ABu{\) + Bu{2) = 0, 

From these equations, it is clear when rank(-B) = n u , that u(-) = «"(•) — «*(•) = and so, 
u°(-) = u*(-). Since represents any sequence that realizes the minimum time, we can 
conclude on the uniqueness of the minimum-time control sequence. □ □ 

It is important to notice that (TT2)) is a property of the system, the set U of admissible controls 
and the initial state Xq. The dependence on the initial state is hidden in the minimum T* . 
Although condition ((12)) may be a little difficult to check in practice, it does consolidate the 
idea that, by choosing the weights sequence to be appropriately increasing, the minimum-time 
control sequence can be computed via convex optimization. And, the reasonably larger the 
control horizon T is, the more likely condition <fl2|) is to hold. 

Remark 1. The method of this paper has been presented only for the case where the target set is reduced 
to a zero singleton. In fact, it can be directly extended to cover the situations where the target is an 
invariant set of the linear transformation x i-> Ax. Such a set is a subspace which equals the null space 
of A — I n with I n being the identity matrix of order n. 

Remark 2. Note that we can, as in iflU/ , impose on both the state and the control input, some linear 
constraints of the form (x(t),u(t)) G Z where 

Z = {(x, it) G R n x M n " : Ex + Fu + A < 0} 

where E G ~R lxn , F G M Zxri ", A G I 1 with I being the number of inequalities. The inequality symbol in 
the definition of Z should be understood component-wise. Imposing such constraints leaves the problem 
© still convex. 

3.2 Online implementation 

The control approach presented above can be implemented online in a similar fashion as the 
so-called Model Predictive Control (MPC) Q. At time t, x{t) is known and u(t) is obtained 
as u(t) = u(t\t), where u(t\t) is the first value of the solution u(t\t), . . . ,u(t + r — l\t) of the 
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optimization problem 



min > w(t + k) \\x(t + 

u(t|t),...,li(t+T-l|t) f"[ 

_ (14) 
subject to Eq. (JT]) 

u(t + fc|i) eU, k = 0, ... ,t- 1. 

Here, r is a time horizon that need not be larger than the minimum time T* . It should however 
be chosen greater than the order n of the system. The control u(t\t) computed from ([14}) can be 
viewed as a function of the state x(t). Hence by denoting u(t\t) = ^(x(t)), the online minimum- 
time control policy can be written as 



u(t) 



H(x(t)) ifx(t)/0 
otherwise. 



Note that it is not necessary to solve problem ((14)) at each sampling time. This can in fact be 
done periodically. For instance one can apply, without additional calculations, the controls 
u(t\t), . . . , u(t + r — l|i) computed at time t to the system, during the period [t, t + r — l]. Hence 
problem (jM)) can be solved periodically at each time qr, q G Z>q. 



4 Numerical results 



4.1 A double integrator system 



A system that has been extensively used in the literature of time-optimal control of continuous- 
time systems is the double integrator system. We found it appropriate to also test our approach 
on that system as this will allow for comparison with the closed-form solution derived in e.g., 
fi"2f. The double integrator is described by a model of the form ((D with 



.4 



1 T e 
1 



and B 



(15) 



where T e is the sampling time which is assumed to be equal to 1. Starting from a nonzero 
initial state, we are interested in determining a control sequence that can drive the double 
integrator to the zero state in the minimum possible time. The control constraint set is defined 
hyU = {ueR: \u\ < 1}. The control horizon is set to T = 10 and the weights are selected to 
be linearly increasing i.e., Wi(t) = at, with a > 0. The proposed algorithm is then run when the 
system starts from a certain number of different initial states. The results for the optimal state 
trajectories are plotted in Figure [TJ An immediate salient observation here is that the obtained 
trajectories are, like in the continuous-time case, switching among parabolic curves whose axis 
of symmetry is the x-axis. However, because the sampling time is relatively large, the parabola 

11 



seem to have been made of segments of lines. The smaller T e is, the smoother the trajectories 
become. Not surprisingly, setting T e small will require more steps to reach the desired zero- 
state. One fundamental difference with the continuous-time control is, as already mentioned, 
that the solution to problem (0 is not necessarily a bang-bang control (see FigureEJ). 




Figure 1: Optimal trajectories of the state corresponding to the minimum-time problem. 



4.2 A multi-input system 



To further illustrate the applicability of our method, we now consider a multivariable linear 
system generated at random with 2 inputs and state dimension equal to 3. The corresponding 
state-space model is described in the form £\) by 



.4 



-0.093 0.25 0.500 
-0.540 -0.255 0.160 
-0.072 0.525 -0.445 



andB 



0.580 -0.360 

2.230 



Deriving a closed-form minimum-time control law for a system of such dimensions is a daunt- 
ing and inextricable task. The method of this paper provides a generic and computational 
alternative to simply obtain the control sequence. The control constraint set is a ball of the form 



U = { 



u £ 



\u\ 



< l}. Starting the system in the state Xq = [10 — 10 5] T and applying our 



method with a control horizon T 



10 and a linearly increasing weight sequence, we obtain the 
12 
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Figure 2: Optimal control trajectories over time samples. 

control and state trajectories plotted in Figure|3j Note that the control tends to take extreme val- 
ues (i.e., such that ||u|| 2 = 1) when the state is far from zero. The values of the control become 
smaller when the state approaches zero. This observation is illustrated in Figure HI 

5 Conclusion 

We have presented a numerical but quite practical solution to the minimum-time control prob- 
lem for discrete-time LTI systems. The optimal control sequence is efficiently obtained via 
a sparse optimization strategy. We showed that, under certain conditions, the time-optimal 
control can be exactly computed using convex optimization techniques for which reliable nu- 
merical solvers exist. The main advantage of our approach is that it is very generic in the sense 
that it can be straightforwardly applied to an arbitrary linear system with more than one input. 
An interesting open issue would be to consider the situations where the state has to be driven 
to zero in minimum-time under the constraint that the state trajectory must pass through some 
pre-specified points. Another research path for future work is to extend the proposed method 
to minimum-time problems involving somewhat arbitrary target sets. 
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Figure 3: State and control trajectories over time samples when xq = [10 — 10 5] 
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Figure 4: Optimal control trajectory for xq = [50 — 50 — 50] 



14 



References 



[1] M. Athans and P. Falb. Optimal Control. An Introduction to the Theory and Its Applications. 
Mcgraw-Hill, 1966. 

[2] L. Bako. Identification of switched linear systems via sparse optimization. Automatica, 
47:668-677, 2011. 

[3] F. Blanchini. Minimum-time control for uncertain discrete-time linear systems. In IEEE 
Conference on Decision and Control, 1992. 

[4] S. Boyd and L. Vandenberghe. Convex Optimization. Cambridge University Press, 2004. 

[5] A. M. Bruckstein, D. L. Donoho, and M. Elad. From sparse solutions of systems of equa- 
tions to sparse modeling of signals and images. SIAM Review, 51:34-81, 2009. 

[6] J. A. E. Bryson and Y.-C. Ho. Applied Optimal Control: Optimization, Estimation and Control. 
Taylor & Francis, 1975. 

[7] E. F. Camacho and C. Bordons. Model predictive control. Springer Verlag, 2nd Ed., 2004. 

[8] E. J. Candes. Compressive sampling. In Proceedings of the International Congress of Mathe- 
maticians, Madrid, Spain, 2006. 

[9] E. J. Candes, M. Wakin, and S. Boyd. Enhancing sparsity by reweighted l\ minimization. 

Journal Fourier Analysis and Applications, 14:877-905, 2008. 

[10] D. Chen, L. Bako, and S. Lecoeuche. A recursive sparse learning method: application to 
jump markov linear systems. In IFAC World Congress, Milan, Italy, 2011. 

[11] C. A. Desoer and J. Wing. A minimal time discrete system. IRE Transactions on Automatic 
Control, AC-6:111-125, 1961. 

[12] Z. Gao. On discrete time-optimal control: a closed-form solution. In American control 
conference, Boston, MA, USA, 2004. 

[13] M. Grant and S. Boyd. CVX: Matlab software for disciplined convex programming, version 
1.2, june 2009, (build 711). June 2009, Build 711. 

[14] S. S. Keerthi and E. G. Gilbert. Computation of minimum-time feedback control laws 
for discrete-time systems with state-control constraints. IEEE Transactions on Automatic 
Control, AC-32:432-435, 1987. 

[15] D. E. Kirk. Optimal Control Theory: An Introduction. Dover Publications, 2004. 

[16] H. Ohlsson, L. Ljung, and S. Boyd. Segmentation of arx-models using sum-of-norms reg- 
ularization. Automatica, 46:1107-1111, 2010. 

15 



[17] J. V. Outrata. On the minimum time problem in linear discrete-time systems with the 
discrete set of admissible controls. Kybernetika, 11:368-374, 1975. 

[18] H. S. Tsien and J. Song. Engineering Cybernetics. Science Press (in Chinese), 1980. 

[19] J. Wright, Y. Ma, J. Mairal, G. Sapiro, T. Huang, and S. Yan. Sparse representation for 
computer vision and pattern recognition. Proceedings of the IEEE, 98:1031-1044, 2010. 

[20] R. Zanasi and R. Morselli. Discrete minimum time tracking problem for a chain of three 
integrators with bounded input. Automatica, 39:1643-1649, 2003. 



16 



